BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Protein_catabolism events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[JULIELab ] Protein_catabolism 14 ( 11) 13 ( 11) 78.57 84.62 81.48
[UT+DBCLS ] Protein_catabolism 14 ( 9) 11 ( 9) 64.29 81.82 72.00
[CNBMadrid] Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
[VIBGhent ] Protein_catabolism 14 ( 9) 15 ( 9) 64.29 60.00 62.07
[ConcordU ] Protein_catabolism 14 ( 9) 16 ( 9) 64.29 56.25 60.00
[ NICTA ] Protein_catabolism 14 ( 6) 7 ( 6) 42.86 85.71 57.14
[ UNSW ] Protein_catabolism 14 ( 7) 11 ( 7) 50.00 63.64 56.00
[ UMich ] Protein_catabolism 14 ( 10) 23 ( 10) 71.43 43.48 54.05
[ASU+HU+BU] Protein_catabolism 14 ( 7) 12 ( 7) 50.00 58.33 53.85
[ UZurich ] Protein_catabolism 14 ( 8) 16 ( 8) 57.14 50.00 53.33
[ UTurku ] Protein_catabolism 14 ( 6) 9 ( 6) 42.86 66.67 52.17
[UAntwerp ] Protein_catabolism 14 ( 9) 21 ( 9) 64.29 42.86 51.43
[ Cam ] Protein_catabolism 14 ( 5) 6 ( 5) 35.71 83.33 50.00
[ UNIMAN ] Protein_catabolism 14 ( 6) 12 ( 6) 42.86 50.00 46.15
[ UAveiro ] Protein_catabolism 14 ( 5) 8 ( 5) 35.71 62.50 45.45
[ UTokyo ] Protein_catabolism 14 ( 4) 5 ( 4) 28.57 80.00 42.11
[CCP-BTMG ] Protein_catabolism 14 ( 4) 6 ( 4) 28.57 66.67 40.00
[ USzeged ] Protein_catabolism 14 ( 6) 17 ( 6) 42.86 35.29 38.71
[ PIKB ] Protein_catabolism 14 ( 4) 7 ( 4) 28.57 57.14 38.10
[CIPS-ASU ] Protein_catabolism 14 ( 8) 29 ( 8) 57.14 27.59 37.21
[ Team 24 ] Protein_catabolism 14 ( 3) 4 ( 3) 21.43 75.00 33.33
[ SCAI ] Protein_catabolism 14 ( 4) 11 ( 4) 28.57 36.36 32.00
[ KoreaU ] Protein_catabolism 14 ( 1) 3 ( 1) 7.14 33.33 11.76
[ Team 09 ] Protein_catabolism 14 ( 0) 0 ( 0) 0.00 0.00 0.00
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Protein_catabolism 14 ( 9) 11 ( 9) 64.29 81.82 72.00
[CNBMadrid] Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
[ASU+HU+BU] Protein_catabolism 14 ( 7) 12 ( 7) 50.00 58.33 53.85
[UAntwerp ] Protein_catabolism 14 ( 9) 21 ( 9) 64.29 42.86 51.43
[CCP-BTMG ] Protein_catabolism 14 ( 4) 6 ( 4) 28.57 66.67 40.00
[ Team 24 ] Protein_catabolism 14 ( 3) 4 ( 3) 21.43 75.00 33.33
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------